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BACKGROUND OF THE INVENTION 



!• Field of the Invention 

5 

This invention is related to the field of superscalar microprocessors and, more 
particularly, to a method and mechanism for branch prediction. 

2. Description of the Related Art 

10 

Superscalar microprocessors achieve high performance by executing multiple 
instructions per clock cycle and by choosing the shortest possible clock cycle consistent 
with the design. As used herein, the term "clock cycle" refers to an interval of time 
accorded to various stages of an instruction processing pipeline within the 

15 microprocessor. Storage devices (e.g. registers and arrays) capture their values according 
to the clock cycle. For example, a storage device may capture a value according to a 
rising or falling edge of a clock signal defining the clock cycle. The storage device then 
stores the value until the subsequent rising or falling edge of the clock signal, 
respectively. The term "instruction processing pipeline" is used herein to refer to the 

20 logic circuits employed to process instructions in a pipelined fashion. Although the 
pipeline may be divided into any number of stages at which portions of instruction 
processing are performed, instruction processing generally comprises fetching the 
instruction, decoding the instruction, executing the instruction, and storing the execution 
results in the destination identified by the instruction. 

25 

An important feature of a superscalar microprocessor (and a superpipelined 
microprocessor as well) is its branch prediction mechanism. The branch prediction 
mechanism indicates a predicted direction (taken or not-taken) for a branch instruction, 
allowing subsequent instruction fetching to continue within the predicted instruction 
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stream indicated by the branch prediction. A branch instruction is an instruction which 
causes subsequent instructions to be fetched from one of at least two addresses: a 
sequential address identifying an instruction stream beginning with instructions which 
directly follow the branch instruction; and a target address identifying an instruction 

5 stream beginning at an arbitrary location in memory. Unconditional branch instructions 
always branch to the target address, while conditional branch instructions may select 
either the sequential or the target address based on the outcome of a prior instruction. 
Instructions from the predicted instruction stream may be speculatively executed prior to 
execution of the branch instruction, and in any case are placed into the instruction 

10 processing pipeline prior to execution of the branch instruction. If the predicted 

instruction stream is correct, then the number of instructions executed per clock cycle is 
advantageously increased. However, if the predicted instruction stream is incorrect (i.e. 
one or more branch instructions are predicted incorrectly), then the instructions from the 
incorrectly predicted instruction stream are discarded from the instruction processing 

15 pipeline and the number of instructions executed per clock cycle is decreased. 

In order to be effective, the branch prediction mechanism must be highly accurate 
such that the predicted instruction stream is correct as often as possible. Frequently, a 
history of prior executions of a branch is used to form a more accurate behavior for a 

20 particular branch. Such a branch prediction history typically requires maintaining data 
corresponding to the branch instruction in a storage. In the event the branch prediction 
data is evicted from the storage, or otherwise lost, it may be necessary to recreate the 
execution history for the branch instruction at a later time. One solution to the above 
problem may be to increase the size of the branch prediction storage. However, increasing 

25 the size of branch prediction storage may require a significant increase in gate area and 
the size of the branch prediction mechanism. Consequently, valuable data regarding the 
behavior of a branch may be lost and must be recreated. Consequently, a mechanism for 
improving branch prediction capability is desired which does not require a significant 
increase in the gate count or size of the branch prediction mechanism. 
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SUMMARY OF THE INVENTION 



The problems outlined above are in large part solved by a microprocessor and 
method as described herein. In one embodiment, a processor is configured with a first 

5 level branch prediction cache which is configured to store branch prediction information 
corresponding to a group of instructions. In addition, a second level branch prediction 
cache is utilized to store branch prediction information which is evicted from the first 
level cache. The second level branch prediction cache is configured to store only a subset 
of the information which is evicted from the first level cache. Branch prediction 

10 information which is evicted from the first level cache and not stored in the second level 
cache is discarded. Upon a miss in the first level cache, a determination is made as to 
whether the second level cache contains branch prediction information corresponding to 
the miss. If corresponding branch prediction information is detected in the second level 
cache, the detected branch prediction information is fetched from the second level cache 

15 and is used to rebuild complete branch prediction information which may then be used in 
making a prediction. In one embodiment, decode circuitry may be included to perform a 
decode of instructions fetched from the second level cache. This decode of instructions 
from the second level cache may be utilized in the rebuilding of the complete branch 
prediction information. Advantageously, a reduced size cache may be used to store 

20 branch prediction information evicted from the first level branch prediction cache. 

Further, when a miss occurs in the first level cache, a complete branch prediction may be 
quickly rebuilt from the data stored in the second level cache. 

25 BRIEF DESCRIPTION OF THE DRAWINGS 

Other objects and advantages of the invention will become apparent upon reading 
the following detailed description and upon reference to the accompanying drawings in 
which: 
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Fig, 1 is a block diagram of one embodiment of a microprocessor. 

Fig. 2 is a block diagram showing one embodiment of a branch prediction unit. 

5 

Fig. 3 is a flowchart illustrating a method for branch prediction. 

Fig. 4 is a flowchart illustrating a method for utilizing a level two branch 
prediction cache. 

10 

Fig. 5 is a diagram showing a contiguous group of program instructions and 
corresponding branch prediction entry. 

i.n 

Q Fig. 6 is a diagram illustrating a relationship between branch marker bits and 

]^ 15 address offsets. 

^ Fig. 7 is a diagram illustrating a relationship between program instructions, branch 

C 5 marker bits and address offsets. 

Q 20 Fig. 8 is a diagram showing one embodiment of prediction logic. 

Fig. 9 is a diagram showing a dynamic logic corollary to the prediction logic 
shown in Fig. 8. 

25 Fig. 10 is a diagram illustrating branch marker bit utilization. 

Fig. 11 is a diagram illustrating branch marker bit utilization. 

Fig. 12 is a diagram illustrating branch marker bit utilization. 

4 



Fig. 13 is a diagram illustrating branch marker bit utilization. 
Fig. 14 is a diagram illustrating a missed prediction. 

5 

Fig. 15 is a diagram illustrating branch target information. 
Fig. 16 is a block diagram showing one embodiment of a prediction logic unit. 
10 Fig. 17 is a diagram illustrating one embodiment of a target select circuit. 

Fig. 18 is a block diagram illustrating one embodiment of a select signal circuit. 
Fig. 19 is a diagram illustrating one embodiment of a branch address calculation 

15 unit. 

Fig. 20 is a block diagram illustrating a relationship between a level one branch 
prediction storage and a level two branch prediction storage. 

20 Fig. 21 is a block diagram illustrating a relationship between a level one branch 

prediction storage and a level two branch prediction storage. 

Fig. 22 is a block diagram illustrating a relationship between a level one branch 
prediction storage and a level two branch prediction storage. 

25 

Fig. 23 is a block diagram of one embodiment of a branch prediction unit. 
Fig. 24 is a diagram of one embodiment of a branch address calculation unit. 

5 



Fig. 25 is a block diagram of one embodiment of a missed prediction circuit. 
Fig. 26 is a block diagram of a computer system. 

5 While the invention is susceptible to various modifications and alternative forms, 

specific embodiments thereof are shown by way of example in the drawings and will 
herein be described in detail. It should be understood, however, that the drawings and 
detailed description thereto are not intended to limit the invention to the particular form 
disclosed, but on the contrary, the intention is to cover all modifications, equivalents and 

10 alternatives falling within the spirit and scope of the present invention as defined by the 
appended claims. 

DETAILED DESCRIPTION 

15 Processor Overview 

Turning now to Fig. 1, a block diagram of one embodiment of a processor 10 is 
shown. Other embodiments are possible and contemplated. As shown in Fig. 1, 
processor 10 includes a prefetch unit 12, a branch prediction unit 14, an instruction cache 

20 16, an instruction alignment unit 18, a plurality of decode units 20A-20C, a plurality of 
reservation stations 22A-22C, a plurality of functional units 24A-24C, a load/store unit 
26, a data cache 28, a register file 30, a reorder buffer 32, an MROM unit 34, and a bus 
interface unit 37. Elements referred to herein with a particular reference number followed 
by a letter will be collectively referred to by the reference number alone. For example, 

25 decode units 20A-20C will be collectively referred to as decode units 20. 

Prefetch unit 12 is coupled to receive instructions from bus interface unit 37, and 
is further coupled to instruction cache 16 and branch prediction unit 14. Similarly, 
branch prediction unit 14 is coupled to instruction cache 16. Still further, branch 
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prediction unit 14 is coupled to decode units 20 and functional units 24. Instruction cache 
16 is further coupled to MROM unit 34 and instruction alignment unit 18, Instruction 
alignment unit 18 is in turn coupled to decode units 20. Each decode unit 20A-20C is 
coupled to load/store unit 26 and to respective reservation stations 22A-22C. Reservation 

5 stations 22A-22C are further coupled to respective functional units 24A-24C. 

Additionally, decode units 20 and reservation stations 22 are coupled to register file 30 
and reorder buffer 32. Functional units 24 are coupled to load/store unit 26, register file 
30, and reorder buffer 32 as well. Data cache 28 is coupled to load/store unit 26 and to 
bus interface unit 37. Bus interface unit 37 is further coupled to an L2 interface to an 12 

10 cache and a bus. Finally, MROM unit 34 is coupled to decode units 20. 

Instruction cache 16 is a high speed cache memory provided to store instructions. 
Instructions are fetched from instruction cache 16 and dispatched to decode units 20. In 
one embodiment, instruction cache 16 is configured to store up to 64 kilobytes of 
15 instructions in a 2 way set associative structure having 64 byte lines (a byte comprises 8 
binary bits). Alternatively, any other desired configuration and size may be employed. 
For example, it is noted that instruction cache 16 may be implemented as a fully 
associative, set associative, or direct mapped configuration. 

20 Instructions are stored into instruction cache 16 by prefetch unit 12. Instructions 

may be prefetched prior to the request thereof from instruction cache 16 in accordance 
with a prefetch scheme. A variety of prefetch schemes may be employed by prefetch unit 
12. Instructions fetched from the instruction cache are passed to the scanner/aligner. 
When instructions are fetched for the first time, they are not marked by predecode tags. In 

25 this case, the scanner/aligner passes 4 bytes per clock to the decode unit 20. As decode 
unit 20 dispatches unpredecoded instructions to the core, the decode unit may generate 
predecode data corresponding to the instructions which indicates the instruction 
boundaries. 
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One encoding of the predecode tags for an embodiment of processor 10 
employing a variable byte length instruction set will next be described. A variable byte 
length instruction set is an instruction set in which different instructions may occupy 
differing numbers of bytes. An exemplary variable byte length instruction set employed 
5 by one embodiment of processor 10 is the x86 instruction set. 

In the exemplary encoding, if a given byte is the last byte of an instruction, the end 
bit for that byte is set. Instructions which may be directly decoded by decode units 20 are 
referred to as "fast path" instructions. The remaining x86 instructions are referred to as 
10 MROM instructions, according to one embodiment. For example, a fast path instruction 
including two prefix bytes, a Mod R/M byte, and an immediate byte would have end bits 
as follows: 



15 



End bits 00001 



MROM instructions are instructions which are determined to be too complex for 
decode by decode units 20. MROM instructions are executed by invoking MROM unit 
34. More specifically, when an MROM instruction is encountered, MROM unit 34 
parses and issues the instruction into a subset of defined fast path instructions to 
20 effectuate the desired operation. MROM unit 34 dispatches the subset of fast path 
instructions to decode units 20. 

Processor 10 employs branch prediction in order to speculatively fetch 
instructions subsequent to conditional branch instructions. Branch prediction unit 14 is 
25 included to perform branch prediction operations. In one embodiment, branch prediction 
unit 14 employs a branch target buffer which caches up to three branch target addresses 
and corresponding taken/not taken predictions per 16 byte portion of a cache line in 
instruction cache 16. The branch target buffer may, for example, comprise 2048 entries 
or any other suitable number of entries. Prefetch unit 12 determines initial branch targets 
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when a particular line is predecoded. Subsequent updates to the branch targets 
corresponding to a cache line may occur due to the execution of instructions within the 
cache line. Instruction cache 16 provides an indication of the instruction address being 
fetched, so that branch prediction unit 14 may determine which branch target addresses to 
5 select for forming a branch prediction. Decode units 20 and functional units 24 provide 
update information to branch prediction unit 14. Decode units 20 detect branch 
instructions which were not predicted by branch prediction unit 14. Functional units 24 
execute the branch instructions and determine if the predicted branch direction is 
incorrect. The branch direction may be "taken", in which subsequent instructions are 

10 fetched from the target address of the branch instruction. Conversely, the branch 

direction may be "not taken", in which subsequent instructions are fetched from memory 
locations consecutive to the branch instruction. When a mispredicted branch instruction 
is detected, instructions subsequent to the mispredicted branch are discarded from the 
various units of processor 10. In an alternative configuration, branch prediction unit 14 

15 may be coupled to reorder buffer 32 instead of decode units 20 and functional units 24, 
and may receive branch misprediction information from reorder buffer 32. A variety of 
suitable branch prediction algorithms may be employed by branch prediction unit 14. 

Instructions fetched from instruction cache 16 are conveyed to instruction 
20 alignment unit 18. As instructions are fetched from instruction cache 16, the 

corresponding predecode data is scanned to provide information to instruction alignment 
unit 18 (and to MROM unit 34) regarding the instructions being fetched. Instruction 
alignment unit 18 scans the predecode data to align an instruction to each of decode units 
20. In one embodiment, instruction alignment unit 18 aligns instructions from two sets of 
25 sixteen instruction bytes to decode units 20. Decode unit 20A receives an instruction 
which is prior to instructions concurrently received by decode units 20B and 20C (in 
program order). Similarly, decode unit 20B receives an instruction which is prior to the 
instruction concurrently received by decode unit 20C in program order. 
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Decode units 20 are configured to decode instructions received from instruction 
alignment unit 18. Register operand information is detected and routed to register file 30 
and reorder buffer 32. Additionally, if the instructions require one or more memory 
operations to be performed, decode units 20 dispatch the memory operations to load/store 
5 unit 26. Each instruction is decoded into a set of control values for functional units 24, 
and these control values are dispatched to reservation stations 22 along with operand 
address information and displacement or immediate data which may be included with the 
instruction. In one particular embodiment, each instruction is decoded into up to two 
operations which may be separately executed by functional units 24A-24C. 

10 

Processor 10 supports out of order execution, and thus employs reorder buffer 32 
to keep track of the original program sequence for register read and write operations, to 
implement register renaming, to allow for speculative instruction execution and branch 
misprediction recovery, and to facilitate precise exceptions. A temporary storage location 

15 within reorder buffer 32 is reserved upon decode of an instruction that involves the 

update of a register to thereby store speculative register states. If a branch prediction is 
incorrect, the results of speculatively-executed instructions along the mispredicted path 
can be invalidated in the buffer before they are written to register file 30. Similarly, if a 
particular instruction causes an exception, instructions subsequent to the particular 

20 instruction may be discarded. In this manner, exceptions are "precise" (i.e. instructions 
subsequent to the particular instruction causing the exception are not completed prior to 
the exception). It is noted that a particular instruction is speculatively executed if it is 
executed prior to instructions which precede the particular instruction in program order. 
Preceding instructions may be a branch instruction or an exception-causing instruction, in 

25 which case the speculative results may be discarded by reorder buffer 32. 

The instruction control values and immediate or displacement data provided at the 
outputs of decode units 20 are routed directly to respective reservation stations 22. In one 
embodiment, each reservation station 22 is capable of holding instruction information 
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(i.e., instruction control values as well as operand values, operand tags and/or immediate 
data) for up to five pending instructions awaiting issue to the corresponding functional 
unit. It is noted that for the embodiment of Fig. 1, each reservation station 22 is 
associated with a dedicated functional unit 24. Accordingly, three dedicated "issue 
5 positions" are formed by reservation stations 22 and functional units 24. In other words, 
issue position 0 is formed by reservation station 22A and functional unit 24A. 
Instructions aligned and dispatched to reservation station 22A are executed by functional 
unit 24A. Similarly, issue position 1 is formed by reservation station 22B and functional 
unit 24B; and issue position 2 is formed by reservation station 22C and functional unit 
10 24C. 



Upon decode of a particular instruction, if a required operand is a register 
=^0 location, register address information is routed to reorder buffer 32 and register file 30 

i?:^ simultaneously. In one embodiment, reorder buffer 32 includes a future file which 

|=S 15 receives operand requests from decode units as well. Those of skill in the art will 
j'" appreciate that the x86 register file includes eight 32 bit real registers (i.e., typically 

referred to as EAX, EBX, ECX, EDX, EBP, ESI, EDI and ESP). In embodiments of 
(j processor 10 which employ the x86 processor architecture, register file 30 comprises 

^ !f storage locations for each of the 32 bit real registers. Additional storage locations may be 

p 20 included within register file 30 for use by MROM unit 34. Reorder buffer 32 contains 
temporary storage locations for results which change the contents of these registers to 
thereby allow out of order execution. A temporary storage location of reorder buffer 32 is 
reserved for each instruction which, upon decode, is determined to modify the contents of 
one of the real registers. Therefore, at various points during execution of a particular 
25 program, reorder buffer 32 may have one or more locations which contain the 

speculatively executed contents of a given register. If following decode of a given 
instruction it is determined that reorder buffer 32 has a previous location or locations 
assigned to a register used as an operand in the given instruction, the reorder buffer 32 
forwards to the corresponding reservation station either: 1) the value in the most recently 
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assigned location, or 2) a tag for the most recently assigned location if the value has not 
yet been produced by the functional unit that will eventually execute the previous 
instruction. If reorder buffer 32 has a location reserved for a given register, the operand 
value (or reorder buffer tag) is provided from reorder buffer 32 rather than from register 
5 file 30. If there is no location reserved for a required register in reorder buffer 32, the 
value is taken directly from register file 30. If the operand corresponds to a memory 
location, the operand value is provided to the reservation station through load/store unit 
26. 

10 In one particular embodiment, reorder buffer 32 is configured to store and 

manipulate concurrently decoded instructions as a unit. This configuration will be 
referred to herein as "line-oriented". By manipulating several instructions together, the 
hardware employed within reorder buffer 32 may be simplified. For example, a line- 
oriented reorder buffer included in the present embodiment allocates storage sufficient for 

15 instruction information pertaining to three instructions (one from each decode unit 20) 
whenever one or more instructions are issued by decode units 20. By contrast, a variable 
amount of storage is allocated in conventional reorder buffers, dependent upon the 
number of instructions actually dispatched. A comparatively larger number of logic gates 
may be required to allocate the variable amount of storage. When each of the 

20 concurrently decoded instructions has executed, the instruction results are stored into 
register file 30 simultaneously. The storage is then free for allocation to another set of 
concurrently decoded instructions. Additionally, the amount of control logic circuitry 
employed per instruction is reduced because the control logic is amortized over several 
concurrently decoded instructions. A reorder buffer tag identifying a particular 

25 instruction may be divided into two fields: a line tag and an offset tag. The line tag 

identifies the set of concurrently decoded instructions including the particular instruction, 
and the offset tag identifies which instruction within the set corresponds to the particular 
instruction. It is noted that storing instruction results into register file 30 and freeing the 
corresponding storage is referred to as "retiring" the instructions. It is further noted that 
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any reorder buffer configuration may be employed in various embodiments of processor 
10, including using a future file to store the speculative state of register file 30. 

As noted earlier, reservation stations 22 store instructions until the instructions are 
5 executed by the corresponding functional unit 24. An instruction is selected for execution 
if: (i) the operands of the instruction have been provided; and (ii) the operands have not 
yet been provided for instructions which are within the same reservation station 22A-22C 
and which are prior to the instruction in program order. It is noted that when an 
instruction is executed by one of the functional units 24, the result of that instruction is 

10 passed directly to any reservation stations 22 that are waiting for that result at the same 
time the result is passed to update reorder buffer 32 (this technique is commonly referred 
to as "result forwarding"). An instruction may be selected for execution and passed to a 
functional unit 24A-24C during the clock cycle that the associated result is forwarded. 
Reservation stations 22 route the forwarded result to the functional unit 24 in this case. 

15 In embodiments in which instructions may be decoded into multiple operations to be 
executed by functional units 24, the operations may be scheduled separately from each 
other. 

In one embodiment, each of the functional units 24 is configured to perform 
20 integer arithmetic operations of addition and subtraction, as well as shifts, rotates, logical 
operations, and branch operations. The operations are performed in response to the 
control values decoded for a particular instruction by decode units 20. It is noted that a 
floating point unit (not shown) may also be employed to accommodate floating point 
operations. The floating point unit may be operated as a coprocessor, receiving 
25 instructions from MROM unit 34 or reorder buffer 32 and subsequently communicating 
with reorder buffer 32 to complete the instructions. Additionally, functional units 24 may 
be configured to perform address generation for load and store memory operations 
performed by load/store unit 26. In one particular embodiment, each functional unit 24 
may comprise an address generation unit for generating addresses and an execute unit for 
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performing the remaining functions. The two units may operate independently upon 
different instructions or operations during a clock cycle. 

Each of the functional units 24 also provides information regarding the execution 
5 of conditional branch instructions to the branch prediction unit 14. If a branch prediction 
was incorrect, branch prediction unit 14 flushes instructions subsequent to the 
mispredicted branch that have entered the instruction processing pipeline, and causes 
fetch of the required instructions from instruction cache 16 or main memory. It is noted 
that in such situations, results of instructions in the original program sequence which 
10 occur after the mispredicted branch instruction are discarded, including those which were 
speculatively executed and temporarily stored in load/store unit 26 and reorder buffer 32. 
It is further noted that branch execution results may be provided by functional units 24 to 
reorder buffer 32, which may indicate branch mispredictions to functional units 24. 

15 Results produced by functional units 24 are sent to reorder buffer 32 if a register 

value is being updated, and to load/store unit 26 if the contents of a memory location are 
changed. If the result is to be stored in a register, reorder buffer 32 stores the result in the 
location reserved for the value of the register when the instruction was decoded. A 
plurality of result buses 38 are included for forwarding of results from functional units 24 

20 and load/store unit 26. Result buses 38 convey the result generated, as well as the reorder 
buffer tag identifying the instruction being executed. 

Lx)ad/store unit 26 provides an interface between functional units 24 and data 
cache 28. In one embodiment, load/store unit 26 is configured with two load/store 
25 buffers. The first load/store buffer includes storage locations for data and address 

information corresponding to pending loads or stores which have not accessed data cache 
28. The second load/store buffer includes storage locations for data and address 
information corresponding to loads and stores which have accessed data cache 28. For 
example, the first buffer may comprise 12 locations and the second buffer may comprise 
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32 locations. Decode units 20 arbitrate for access to the load/store unit 26. When the 
first buffer is full, a decode unit must wait until load/store unit 26 has room for the 
pending load or store request information. Load/store unit 26 also performs dependency 
checking for load memory operations against pending store memory operations to ensure 
5 that data coherency is maintained. A memory operation is a transfer of data between 
processor 10 and the main memory subsystem. Memory operations may be the result of 
an instruction which utilizes an operand stored in memory, or may be the result of a 
load/store instruction which causes the data transfer but no other operation. Additionally, 
load/store unit 26 may include a special register storage for special registers such as the 
10 segment registers and other registers related to the address translation mechanism defined 
by the x86 processor architecture. 

Data cache 28 is a high speed cache memory provided to temporarily store data 
being transferred between load/store unit 26 and the main memory subsystem. In one 
15 embodiment, data cache 28 has a capacity of storing up to 64 kilobytes of data in an two 
way set associative structure. It is understood that data cache 28 may be implemented in a 
variety of specific memory configurations, including a set associative configuration, a 
fully associative configuration, a direct-mapped configuration, and any suitable size of 
any other configuration. 

20 

In one particular embodiment of processor 10 employing the x86 processor 
architecture, instruction cache 16 and data cache 28 are linearly addressed and physically 
tagged. The linear address is formed from the offset specified by the instruction and the 
base address specified by the segment portion of the x86 address translation mechanism. 
25 Linear addresses may optionally be translated to physical addresses for accessing a main 
memory. The linear to physical translation is specified by the paging portion of the x86 
address translation mechanism. The physical address is compared to the physical tags to 
determine a hit/miss status. 
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Bus interface unit 37 is configured to communicate between processor 10 and 
other components in a computer system via a bus. For example, the bus may be 
compatible with the EV-6 bus developed by Digital Equipment Corporation. 
Alternatively, any suitable interconnect structure may be used including packet-based, 
5 unidirectional or bi-directional links, etc. An optional L2 cache interface may be 
employed as well for interfacing to a level two cache. 

For the remainder of this description, the x86 microprocessor architecture will be 
used as an example. However, the branch prediction technique described herein may be 

10 employed within any microprocessor architecture, and such embodiments are 

contemplated. It is noted that, in the x86 microprocessor architecture, there is defined a 
subroutine return instruction (e.g. the RET instruction) consisting of a single byte 
opcode. The subroutine return instruction specifies that its branch target address is drawn 
from the top of the stack indicated by the ESP register. Handling of this single byte RET 

15 instruction may present special issues in some circumstances. A mechanism for dealing 
with this case is illustrated in more detail below. 

Branch Prediction Overview 

20 

Fig. 2 shows a portion of one embodiment of branch prediction unit 14. Other 
embodiments of branch prediction unit 14 in addition to the portion shown in Fig. 2 are 
possible and are contemplated. As shown in Fig. 2, branch prediction unit 14 includes 
global predictor storage 205, local predictor storage 206, branch target storage 208, 

25 update logic 200 and 202, global history shift register 204, line buffer 210, return address 
stack 230, sequential address generator 232, prediction logic 220, victim cache 260, 
branch address calculator 270, instruction cache 16, L2 cache 1828, and decoder circuit 
400. Victim cache 260 is a level two (L2) cache configured to store branch prediction 
information evicted from local predictor storage 206. In one embodiment, victim cache 

30 260 is configured to cache only data that was previously held in local predictor storage 
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206 but was evicted to make room for other data. Advantageously, because local 
predictor storage 206 and victim cache 260 do not store duplicate data, more branch 
prediction information may be maintained. 



5 Global predictor storage 205, local predictor storage 206, branch target storage 

208, instruction cache 16, prediction logic 220, branch address calculator 270, and line 
buffer 210 are coupled to a fetch address bus 236 from fetch address multiplexor 222. 
Global history shift register 204 is coupled to global predictor storage 205 and line buffer 
210 via bus 234. Update logic 200 is coupled to global predictor storage 205, local 

10 predictor storage 206 and branch target storage 208. Line buffer 210 is coupled to update 
logic 200 and 202 via bus 248. In addition, update logic 202 is coupled to global history 
shift register 204 via bus 246. Reorder buffer 32 provides selection control and a redirect 
address to multiplexor 222. Reorder buffer 32 also provides branch predicted behavior 
and actual behavior information to update logic 200 and update logic 202. Global 

15 predictor storage 205 and local prediction storage 206 are coupled to prediction logic 220 
via buses 238 and 242, respectively. Prediction logic 220 is coupled to branch address 
calculator 270 via bus 250 and multiplexor 212 via select signal 240. Instruction cache 16 
is coupled to branch address calculator 270 via bus 241. Multiplexor output 212 is 
coupled to branch address calculator 270 and multiplexor 221 via bus 243. And branch 

20 address calculator 270 is coupled to multiplexor 221 via bus 245, and multiplexor 221 via 
select signal 223. Finally, the output from multiplexor 221 is coupled to multiplexor 222. 

In general, the basic operation of the portion of branch prediction unit 14 shown in 
Fig. 2 is as follows. A fetch address 236 is conveyed to line buffer 210, local predictor 
25 storage 206, target array storage 208 and branch address calculator 270. In addition, a 

portion of the fetch address 236 is combined with global history 234 to form an index into 
global predictor storage 205. Further, a portion 225 of fetch address 236 is conveyed to 
prediction logic 220. Global predictor storage 205 conveys a global prediction 238, local 
predictor storage 206 conveys a local prediction 242 and target array 208 conveys a target 
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address corresponding to the received fetch address. The local prediction 242 conveyed 
by local predictor storage 206 provides information to prediction logic 220 for use in 
forming a branch prediction. Likewise, global predictor storage 205 conveys a global 
prediction 238 to prediction logic 220 for use in forming the branch prediction. In one 
5 embodiment, global prediction 238 may override a local prediction 242 provided by local 
predictor storage 206 for branches which have exhibited dynamic behavior. Classification 
of branches as exhibiting dynamic behavior will be discussed below. Finally, prediction 
logic 220 conveys a signal to multiplexor 212 which selects a next fetch address 243 for 
use in fetching new instructions. In certain instances, the fetch address 243 conveyed by 

10 multiplexor 212 will be the only fetch address conveyed for the current branch prediction. 
However, in other cases, branch address calculator 270 may convey a second fetch 
address 245 corresponding to the current branch prediction in response to determining the 
fetch address 243 conveyed by multiplexor 212 was incorrect. In such a case, branch 
address calculator 270 may convey a signal 223 for selecting fetch address 245 for output 

15 from multiplexor 221. In this manner, a misprediction may be determined and corrected 
at an early stage. 

Dynamic Behavior and Global Classification 

20 As mentioned above, in one embodiment a global prediction mechanism may be 

included in branch prediction unit 14. Details of a global prediction mechanism may be 
found in the following co-pending, commonly assigned patent application: "Dynamic 
Classification of Conditional Branches in Global History Branch Prediction", Serial No. 
09/441,630, filed November 16, 1999 by Zuraski, Jr. et al., the disclosures of which is 

25 incorporated herein by reference. As previously indicated, prefetch unit 12 may be 

configured to detect branch instructions and to convey branch information corresponding 
to a branch instruction to branch prediction unit 14. When a conditional branch is 
detected, update logic 200 may create a corresponding branch prediction entry in local 
predictor storage 206 and initialize the newly created branch prediction entry to not taken. 
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In one embodiment, local predictor storage 206 may store branch prediction information, 
including branch markers, for use in making a branch prediction and choosing from 
among a plurality of branch target addresses stored in branch target storage 208, a 
sequential address 232, or return stack address 230. Upon creating an entry in local 
5 predictor storage 206 for a branch, the predicted direction of the branch is initialized to 
not taken and the corresponding branch marker is initialized to indicate a sequential 
address 232. In addition, an entry corresponding to a conditional branch is created in line 
buffer 210. A line buffer entry may comprise a global history, fetch address, global 
prediction and global bit. 

10 

When a branch has a not taken prediction in local predictor storage 206, a 
sequential address 232 is conveyed from multiplexor 212. Final prediction 250 is 
conveyed to update logic 202 which shifts the predicted direction of branches classified 
as dynamic into global history shift register 204. When a local branch prediction entry 

15 indicates a branch is predicted not taken, final prediction 250 indicates the branch is not 
taken and signal 240 selects sequential address 232 from multiplexor 212 as the next 
fetch address. On subsequent executions of the branch, prior to the branch prediction 
entry being deleted from branch prediction unit 14, the predicted direction for the branch 
is not taken and the sequential address 232 is conveyed as the next fetch address. Upon 

20 retirement, the corresponding entry in line buffer 210 is conveyed to update logic 200 and 
update logic 202 and deleted from line buffer 210. When a line buffer entry indicates a 
branch is classified as non-dynamic and reorder buffer 32 indicates the branch was 
correctly predicted, no update by update logic 200 or 202 is performed. However, if the 
branch was classified as non-dynamic and was mispredicted, the branch prediction 

25 corresponding to the mispredicted branch is updated and the global history shift register 
204 is updated as discussed below. 
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Non-Dynamic - Taken Branches 



Upon retirement or mispredict, reorder buffer 32 conveys information regarding 
the behavior of a branch to update logic 200. Also, line buffer 210 conveys a line buffer 
5 entry to update logic 200 and 202. When a line buffer branch entry indicates a branch is 
classified as non-dynamic and predicted not taken, and reorder buffer 32 indicates the 
corresponding branch was mispredicted, update logic 200 updates the branch prediction 
entry corresponding to the mispredicted branch. Update logic 200 updates the branch 
prediction in local predictor storage 206 from not taken to taken and enters the branch 

10 target address in branch target storage 208. A "dynamic" (or "global") bit associated with 
the stored branch target address is initialized to indicate the branch is classified as static, 
or non-dynamic, which may be represented by a binary zero. On subsequent executions of 
the branch, and prior to the branch prediction entry being deleted from branch prediction 
unit 14, the branch prediction entry indicates a taken prediction and a classification of 

15 non-dynamic. When a branch is predicted taken and classified as non-dynamic, prediction 
logic 220 selects a target from multiplexor 212. As before, if the branch is correctly 
predicted no branch prediction update is required by update logic 200 or 202. On the 
other hand, if a non-dynamic predicted taken branch is not taken, the branch prediction 
entry and global history shift register 204 are updated. 

20 

Dynamic Branches 

When a branch which is classified as non-dynamic and predicted taken is 
mispredicted, update logic 200 updates the dynamic bit corresponding to the mispredicted 

25 branch in local predictor storage 206 to indicate the branch is classified as dynamic, or 
global. In addition, update logic 200 updates the global prediction entry in global 
prediction storage 204 corresponding to the mispredicted branch to indicate the branch is 
predicted not taken. Also, update logic 202 updates global history shift register 204 to 
indicate the branch was not taken. In one embodiment, global history shift register 204 

30 tracks the behavior of the last 8 dynamic branches. 

20 



When a dynamic branch is fetched, fetch address 236 is conveyed to local 
predictor storage 206, target array 208 and line buffer 210. In addition, the fetch address 
is combined with the contents of global history shift register 204 to form an index 203 
5 which is conveyed to global predictor storage 205. The contents of global history shift 
register 204 are also conveyed to line buffer 210 via bus 234, In one embodiment, index 
203 is formed by concatenating bits 9 through 4 of the fetch address 236 with the contents 
of global history shift register 204. Other methods of forming an index, such as ORing or 
XORing, are contemplated as well. The index selects an entry in global predictor storage 

10 205 which is conveyed to line buffer 210, update logic 202 and multiplexor 220. The 
predicted direction of the branch conveyed by global predictor storage 204 is shifted into 
the global history shift register 204 by update logic 202. For example, a binary one may 
represent a taken branch and a binary zero may represent a not taken branch. If the 
corresponding dynamic bit indicates the branch is classified as global and the global 

15 prediction indicates the branch is taken, the target address conveyed from multiplexor 212 
is selected as the next fetch address. If the global prediction indicates the branch is not 
taken, the sequential address 232 is selected from multiplexor 212 as the next fetch 
address. 

20 Upon retirement, reorder buffer 32 conveys branch information to update logic 

200 and update logic 202. In addition, line buffer 210 conveys the corresponding branch 
information to update logic 202. When reorder buffer 32 indicates a dynamic branch is 
correctly predicted, update logic 200 modifies global prediction entry 205 to indicate the 
behavior of the branch. In one embodiment, global branch prediction entries comprise a 

25 saturating counter. Such a counter may be two bits which are incremented on taken 
branches and decremented on not taken branches. Such an indicator may be used to 
indicate a branch is strongly taken, weakly taken, strongly not taken, or weakly not taken. 
If a dynamic branch is mispredicted, update logic 200 updates the global prediction entry 
205 to indicate the branch behavior. In addition, upon misprediction update logic 202 
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repairs global history shift register 204 to reflect the actual, rather than the predicted, 
behavior of the dynamic branch. 

Victim Branch Prediction Cache 

5 

The above overview of branch prediction unit 14 operation assumes a branch 
prediction for a corresponding fetch address exists in local predictor storage 206. 
However, a branch prediction corresponding to a received fetch address may not exist in 
local predictor storage 206. A general overview of a method for handling this scenario 
10 will be discussed next. 

Fig. 3 is a flowchart illustrating one embodiment of a method for creating a 
branch prediction entry in a first level (LI) branch prediction storage 206 which includes 
by evicting an existing branch prediction entry and storing a subset of the evicted branch 

15 prediction information in a second level (L2) storage. Utilization of a second level branch 
prediction storage 260 advantageously allows the retention of branch prediction 
information which is evicted from the LI predictor storage 206. Those skilled in the art 
will recognize that making an accurate prediction for a particular branch may require the 
creation of a branch execution history over a number of executions of a branch. 

20 Consequently, retaining branch prediction information corresponding to an evicted branch 
prediction in a cache may improve the accuracy of branch predictions. Upon detecting a 
required reload into LI storage 206 (decision block 301) a determination is made 
(decision block 303) as to whether there exists room in the corresponding entry of the LI 
branch predictor storage 206 for a branch prediction. In the event the entry in the LI 

25 branch predictor storage 206 which corresponds to the reload data is already occupied, the 
existing entry may be evicted (block 305) and only a subset of the evicted branch 
prediction information is stored in the L2 storage 260 (block 307). If the reload data is 
being fetched from the L2 storage 260 (decision block 309), the data fetched from the L2 
storage 260 includes a subset of branch prediction entry which may be used to rebuild a 
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corresponding full branch prediction entry (block 311). The rebuilt entry may then be 
stored in the LI storage 206 (block 315). Alternately, if the reload data is not being 
fetched from the L2 storage 260 (decision block 309), a new branch prediction entry is 
initialized (block 313) and stored in the LI storage (block 315). 

5 

Fig. 4 illustrates an alternate embodiment of a method wherein a corresponding 
branch prediction is not present in an LI branch predictor storage. Initially, a fetch 
address is presented to an LI branch predictor storage 206 (block 400). Upon presentation 
of the fetch address, a determination is made as to whether a branch prediction 

10 corresponding to the presented fetch address is present in the LI predictor storage 

(decision block 402). In the event a corresponding branch prediction is present in the LI 
storage, the prediction is conveyed (block 418). However, in the event there is no 
corresponding branch prediction in the LI storage 206, a determination is made as to 
whether the entry in the LI predictor storage 206 that corresponds to the fetch address is 

15 occupied by a branch prediction entry corresponding to an alternate fetch address 
(decision block 404). If another entry is present in the LI predictor storage 206, the 
existing entry is evicted from the LI predictor storage 206 (block 406). If the 
corresponding LI predictor storage entry is not occupied by a valid entry, an L2 predictor 
storage 260 is queried for a branch prediction entry corresponding to the fetch address 

20 (block 408). In one embodiment, LI predictor storage 206 and L2 predictor storage 260 
may be queried in parallel. If no corresponding entry is present in the L2 predictor storage 
260 (block 410), a new branch prediction entry may be created in the LI predictor storage 
206 for the presented fetch address (block 412). On the other hand, if there exists an entry 
in the L2 branch predictor storage 260 corresponding to the fetch address, data from the 

25 L2 entry is utilized to rebuild a full branch prediction corresponding to the fetch address 
(block 414). The rebuilt branch prediction is then stored in the LI branch predictor 
storage (block 416) and is conveyed (block 418) for use in making a branch prediction. 
Advantageously, branch prediction information corresponding to a branch instruction 
may be recovered from an L2 branch predictor storage, rather than having to rebuild it 
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through a history of branch executions. Further, only a subset of information 
corresponding to the branch prediction need be stored in the L2 branch prediction storage 
260. In this manner, the size of the L2 branch prediction storage 260 may be made 
smaller. 

5 

Local Branch Predictor Storage 

In one embodiment, local predictor storage 206 may be organized in the same 
manner as instruction cache 16. Data stored in local predictor storage 206 may consist of 

10 lines of storage organized in ways. In one embodiment, local predictor storage 206 is of 
sufficient size to cover all entries in the instruction cache 16. In an alternative 
embodiment, local predictor storage 206 may be smaller than instruction cache 16. For 
example, local predictor storage 206 may be the size of instruction cache 16. In such an 
embodiment, additional bits may be stored along with a local prediction in local predictor 

15 storage 206 in order to distinguish entries for multiple fetch addresses which index to the 
same storage location within local predictor storage 206. In one embodiment, global 
predictor storage 205 may be configured such that a single storage location provides a 
prediction for more than one fetch address. Those skilled in the art will readily recognize 
numerous possible configurations for local predictor storage 206 and global predictor 

20 storage 205 are possible. 

Turning now to Fig. 5, a diagram of an exemplary group of contiguous instruction 
bytes 50 and a corresponding entry in local predictor storage 206 are shown. In Fig. 5, 
each byte within an instruction is illustrated by a short vertical line (e.g., reference 
25 number 54). Additionally, the vertical lines separating instructions in group 50 delimit 
bytes (e.g. reference number 56). The instructions shown in Fig. 5 are variable in length, 
and therefore the instruction set, including the instructions shown in Fig. 5, is a variable 
byte length instruction set. In other words, a first instruction within the variable byte 
length instruction set may occupy a first number of bytes which is different than a second 
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number of bytes occupied by a second instruction within the instruction set. Other 
instruction sets may be fixed-length, such that each instruction within the instruction set 
occupies the same number of bytes as each other instruction. 



5 As illustrated in Fig. 5, group 50 includes non-branch instructions IN0-IN4. 

Instructions INO, INS, and IN4, are two byte instructions. Instruction INI is a one byte 
instruction and instruction IN2 is a three byte instruction. Three predicted-taken branch 
instructions PBO, PBl, and PB2 are illustrated as well, each shown as occupying two 
bytes. It is noted that both non-branch and branch instructions may occupy various 
1 0 numbers of bytes . 

As used herein, the offset of an address comprises a number of least significant 
bits of the address. The number is sufficient to provide different encodings of the bits for 
each byte within the group of bytes to which the offset relates. For example, group 50 is 
15 16 bytes, bytes 0-15. Therefore, four least significant bits of an address within the group 
form the offset of the address. The remaining bits of the address identify group 50 from 
other groups of contiguous instruction bytes within the main memory. Additionally, a 
number of least significant bits of the remaining bits form an index used by instruction 
cache 16 to select a row of storage locations which are eligible for storing group 50. 

20 

Set 52 is an exemplary set of nine branch marker bits 0-8 corresponding to group 
50. Each of the nine branch marker bits within set 52 corresponds to particular bytes of 
group 50 and indicate whether a predicted taken branch instruction ends within the 
corresponding bytes. In the embodiment shown, branch marker bit 0 corresponds to 
25 instruction byte 0, branch marker bit 1 corresponds to instruction bytes 1-2, branch 
marker bit 2 corresponds to instruction bytes 3-4, branch marker bit 3 corresponds to 
instruction bytes 5-6, branch marker bit 4 corresponds to instruction bytes 7-8, branch 
marker bit 5 corresponds to instruction bytes 9-10, branch marker bit 6 corresponds to 
instruction bytes 11-12, branch marker bit 7 corresponds to instruction bytes 13-14, and 



25 



branch marker bit 8 corresponds to instruction byte 15. In addition to branch marker bits 
52, branch prediction information 450 corresponding to branch marker bits 52 is also 
included. Branch prediction information 450 includes information corresponding to 
predicted taken branches and may be used in making a branch prediction as discussed 
5 further below. 

In the embodiment shown in Fig. 5, a branch marker bit is set to "1" to indicate a 
predicted taken branch instruction ends within the corresponding byte range. If no 
predicted taken branch instruction ends within the byte range corresponding to a branch 

10 marker bit, the branch marker bit is set to "0". Consequently, branch marker bit two is set 
to indicate a predicted taken branch, PBO, ends within the instruction byte range 3-4. 
Branch marker bit six is set to indicate a predicted taken branch, PBl, ends within 
instruction byte range 11-12. Finally, branch marker bit seven is set to indicate a 
predicted taken branch, PB2, ends within instruction byte range 13-14. In one 

15 embodiment, up to three predicted taken branches may be indicated by branch marker bits 
52. In such an embodiment, branch prediction information 450 may contain information 
pertaining to three separate branch instructions. Such information 450 may include the 
type of branch instruction and indicate information on the past behavior of the 
corresponding branch. Branch prediction information 450 will be discussed further in the 

20 discussion of Fig. 15. 

Upon presentation of a fetch address to local predictor storage 206, a group of 
branch marker bits 52 and branch information 450 are conveyed to prediction logic 220 
for use in making a branch prediction. In one embodiment, the offset of the fetch address 
25 may be used to identify which of the branch marker bits 52 are to be considered in 

making a branch prediction. Turning to Fig. 6, one embodiment of a relationship between 
branch marker bits 52 and fetch address offsets is shown. In Fig. 6, a table with columns 
602-618 includes an offset address and a corresponding branch marker bit. In general, 
whether or not a branch marker bit is considered in making a prediction depends on 
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whether the corresponding offset satisfies the condition indicated in the table. For 
example, column 602 illustrates that if the offset of an address is less than or equal to 
zero, then all branch marker bits will be considered in making a branch prediction. In this 
manner, the table shows the lowest numbered branch marker bit that will be considered 
5 for a given offset. Consequently, if an offset is equal to seven, then branch marker bits 
four through eight will be considered. If an offset is equal to fifteen, then only branch 
marker bit eight will be considered. 

Turning now to Fig. 7, a diagram illustrating the above described relationships 
10 between instruction bytes and branch marker bits is shown. Fig. 7 shows instruction bytes 
50 and corresponding branch marker bits. Also illustrated are the instruction byte# 702, 
branch marker bit# 704, the instruction bytes to which each branch marker bit 
corresponds 706, and the fetch address offset 708 which corresponds to each branch 
marker bit. Branch information 450 is not shown. As discussed with reference to Fig. 5, 
15 three predicted taken branch instructions, PB0-PB2, are shown with corresponding 

branch marker bits 2, 6 and 7 being set. As an example, assume a fetch address with an 
offset of 3 is presented to local predictor storage 206. In such a scenario, branch marker 
bits 2-8 all satisfy the conditions of the respective bit (i.e., offset<=3 for branch marker 
bit 2, offset<=5 for branch marker bit 3, etc.). Consequently, branch marker bits 2-8 are 
20 utilized and branch marker bits 0-1 may be effectively ignored when making a branch 
prediction as they correspond to an instruction prior in sequence to the instruction 
currently being fetched. In this manner, determining which branch marker bits to consider 
in making a prediction may be readily ascertained. 

25 Fig. 8 represents one embodiment of how branch marker bits 52 may be utilized to 

make a prediction. Included in Fig. 8 is circuitry 802 which compares a received fetch 
address offset (represented by "a" in the figure) to the values 0, 1, 3, 5, 7, 9, 11, 13 and 15 
which correspond to offset values 708 shown in Fig. 7. In each case where the received 
offset is less than or equal to the value being compared to, a signal 808 indicating this fact 



27 



is conveyed to an AND gate 804. In addition, each of branch marker bits 52 are conveyed 
to AND gates 804 as well. Logical AND gates 808 are coupled to logical OR gate 806 
whose output indicates whether a branch prediction is being made. Referring to the 
example of Fig. 8, assume as before a fetch address is received with an offset equal to the 
5 value 3. As indicated in Fig. 7 the instruction with offset 3 corresponds to predicted taken 
branch PBO. Subsequently, corresponding branch marker bits 52 are conveyed from local 
predictor storage 206 to the logic depicted in Fig. 8. Circuitry 802 receives the offset with 
value 3 and asserts signals 808C-808I which are received by gates 804C-804I, 
respectively. In addition, branch marker bits 2, 6 and 7 convey a binary value of "1" to 
10 gates 804C, 804G and 804H, respectively. The remaining branch marker bits convey a 
binary value of "0". Consequently, each of gates 804C, 804G and 804H convey a binary 
value of "1" to gate 806, which in turn conveys a binary value of "1" indicating a branch 
prediction is being made. 

15 Fig. 9 illustrates one embodiment 900 of the circuitry depicted in Fig. 8 using 

dynamic logic. Those skilled in the art will readily understand the operation of dynamic 
logic. Fig. 9 includes coupled transistors 902A-902I which may be seen to correspond to 
logical AND gates 804A-804I, respectively. Also included is transistor 904 which may 
supply a precharged value for the dynamic logic, and an inverter 906. Initially, the output 

20 908 of inverter 906 conveys a binary state of "0" during an evaluation phase of the circuit 
indicating no branch prediction is being made. However, in the event one or more of 
gates 902 has both inputs asserted, the output 908 of inverter 906 transitions to a binary 
value of "1" indicating a branch prediction is being made. Those skilled in the art will 
readily ascertain that there are many ways in which the logic of Figs. 9 and 10 may be 

25 implemented to accomplish the same task. 

Branch Marker Bit Update 

Branch instructions generally include at least an opcode (identifying the branch 
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instruction within the instruction set employed by microprocessor 10) and a displacement 
to be added to the address of the branch instruction (or the address of the instruction 
immediately following the branch instruction) to form the branch target address. 
Therefore, a branch instruction typically occupies at least two bytes. By taking advantage 
5 of this fact, a branch marker bit need not be stored for every instruction byte and the 
number of branch marker bits stored with respect to a group of contiguous instruction 
bytes may be reduced. However, a particular case of note exists involving the single byte 
RET instruction in which a branch marker is set to indicate a predicted taken branch, but 
the branch prediction may be missed. Embodiments for handling this particular case will 
10 be discussed. 

Figs. 11-15 provide examples of updating branch marker bits. Fig. 10 shows a 
group of contiguous instruction bytes 50, branch marker bits 52, and branch information 
450, In the example of Fig. 10, no taken branches are predicted and no branch marker bits 

15 52 are set. Turning now to Fig. 11, instruction bytes 50, marker bits 52, and branch 
information 450 are shown subsequent to detecting a predicted taken branch and a 
corresponding update of branch marker bits 52. Fig. 1 1 shows a predicted taken branch 
PBO 1201 is detected in instruction bytes 50 at instruction bytes #8 and #9. Because the 
predicted taken branch ends in instruction byte #9, branch marker bits 52 are updated by 

20 setting branch marker bit #5 1203 to a binary value of "1". In addition, in one 

embodiment, each of branch information entries 500A-500C may correspond to a first, 
second, and third predicted taken branch, respectively, appearing in instruction bytes 50. 
In such an embodiment, predicted taken branch PBO 1201 may be detected to be the first 
predicted taken branch appearing within the group of instruction bytes 50. Consequently, 

25 information corresponding to branch instruction PBO 1201 may be stored in branch 
information entry 500A. 

Fig. 12 illustrates updating of branch marker bits 52 in response to detecting a 
second predicted taken branch. Predicted taken branch PBl 1301 is detected within group 



29 



50. In response to detecting branch PBl 1301 and because branch PBl 1301 ends in 
instruction byte #3, branch marker bit #2 1303 is set to a binary value of "1". Further, in 
the embodiment shown, newly detected branch PBl 1301 is determined to be the first 
predicted taken branch within group 50. Consequently, branch information corresponding 
5 to branch PBl 1301 corresponds to branch information entry 500 A. However, branch 
information entry 500A currently contains branch information corresponding to branch 
PBO 1201 as described in the discussion of Fig. 11. Consequently, the data within entry 
500A is shifted to entry 500B, and the new branch information corresponding to branch 
PBl 1301 is stored in entry 500A. 

10 

Fig. 13 illustrates the update of a predicted taken branch entry. In the example of 
Fig. 13, a prediction of not taken is subsequently determined for branch PBl 1301. In 
order to update the taken prediction for PBl 1301, the corresponding dynamic bit 500 A is 
set to a binary value of "1". Therefore, branch predictions corresponding to branches PBO 
15 and PBl are present. However, branch PBl is classified as dynamic 500 A and branch 
PBO remains classified as local 500B. 

In the discussion above, each of branch information entries 500A-500C are 
described as corresponding to a particular predicted taken branch within group 50. For 

20 example, entry 500A corresponds to a first predicted taken branch appearing within group 
50, entry 500B corresponds to a second, and entry 500C corresponds to a third. 
Consequently, to maintain this correspondence subsequent to updates, data within entries 
500A-500C may be shifted. In general, when a new entry is created, data entries 
corresponding to that entry and all others to the right of that entry are shifted to the right 

25 to make room for the new entry. For example, if a newly predicted taken branch is 

detected which corresponds to entry 500A and entry 500A already stores a valid entry, 
then the contents of entry 500 A are shifted to entry 500B, the contents of entry 500B are 
shifted to entry 500C, and the contents of entry 500C are shifted out of branch 
information 450 and lost. In one embodiment, target addresses in target array 208 may be 
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similarly shifted to maintain a correspondence between predicted taken branches in group 
50, branch information in entries 500, and targets in target array 208. While the above 
embodiment describes maintaining a correspondence by shifting data between entries, 
other embodiments are possible and are contemplated. For example, rather than moving 
5 data between entries, bits stored within an entry 500 and an entry in target array 208 may 
relate entries to a particular branch. 

As mentioned above, a special case exists for a single byte branch instruction. Fig. 
14 illustrates an example where such a prediction for a single byte branch instruction may 

10 be missed. Fig. 14 shows a contiguous group of instruction bytes which includes a single 
byte RET instruction 1501 in byte position 8. Branch marker bit #4 1503 is set to indicate 
a predicted taken branch, RET instruction 1501, ends in the instruction byte range 7-8. No 
other predicted taken branches are indicated. Now assume an example where a fetch 
address is received with an offset of 8 indicating the RET instruction 1501. Branch 

15 marker bit #4 indicates we wish to make a branch prediction for this instruction. 
However, when the branch marker bits are conveyed for the purpose of making a 
prediction, corresponding branch marker bit #4 does not meet the requirements of that 
marker bit position for consideration (i.e., an offset with a value equal to 8 is not <= 7) 
and branch marker bit #4 will be effectively ignored. As illustrated by the logic in Fig. 8, 

20 branch marker bit #4, b4, is set and will be conveyed to gate 804E. However, signal 808E 
which is also coupled to gate 808E will not be set because its condition, offset <=7, does 
not evaluate to true. Consequently, no branch prediction will be indicated by the logic in 
Fig. 8. In general, this missed prediction scenario may occur whenever the single byte 
RET instruction appears in any of instruction byte positions 2, 4, 6, 8, 10, 12, or 14. 

25 Various embodiments and mechanisms for handling this special case will be discussed 
below. 
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Branch Instruction Information 

Turning now to Fig. 15, one embodiment of branch prediction information 450 is 
shown. As discussed above, each group of contiguous instruction bytes 50 has a 

5 corresponding set of branch marker bits 52 and branch prediction information 450 stored 
in local predictor storage 206. In the embodiment shown, branch prediction information 
450 includes information for three branch instructions, 500A-500C. Included in each of 
500A-500C are six bits providing information corresponding to a predicted taken branch. 
As shown in Fig. 15, the branch prediction information includes a dynamic bit 502, an 

10 end adjustment bit 504, and four bits 506 serving to classify the type and size of branch 
instruction. Dynamic bit 502 may be utilized to indicate a global branch prediction from 
global predictor 205 is to be used, rather than a local branch prediction from local 
predictor 206. End adjustment bit 504 may be used to indicate whether the corresponding 
branch instruction ends on an even or odd byte. Finally, branch information 506 may be 

15 used to classify the type and size of a branch instruction. 

Also shown in Fig. 15 are four exemplary encodings of branch information 506. 
As indicated, each branch instruction includes an end bit 504 (bit position 4 in the 
example). A first encoding 508 may be used to indicate a conditional or unconditional 

20 branch instruction by setting the third and second bits to "0" and "0", respectively. A 
second encoding 510 may be used to indicate a call instruction by setting the third and 
second bits to "0" and "1", respectively. A third encoding 512 may be used to indicate a 
return type instruction by setting bits three through zero to "1000". Finally, a fourth 
encoding (514) may be used to indicate a one byte return opcode ending on an even byte 

25 by setting bit three to "1" and bits two to zero to a value other than "000". Each of the first 
two encodings 508-510 also include a field (bits one and zero) for indicating a size of any 
immediate or displacement data for the instruction. In one embodiment, one, two, or four 
bytes of data may be indicated by encoding bits one and zero as "00", "01", and "10", 
respectively. Finally, the fourth encoding 514 depicted in Fig. 15 includes a field (bits 
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two through zero) for indicating which non-zero, even instruction byte within the group 
50 that the single byte return instruction appears. In the above described embodiment, the 
position field in encoding four 514 may assume one of seven values, "001"-"! IF', which 
may correspond to byte positions 2, 4, 6, 8, 10, 12 and 14, respectively. Usage of the 
5 branch information described above will be illustrated in the discussions below. 

Prediction Logic 

Turning now to Fig. 16, one embodiment of prediction logic 220 is shown. 

10 Included in Fig. 16 are comparison circuitry 802, local prediction circuit 900, target select 
circuit 1100, and control circuit 1102. Comparison circuit 802 is coupled to receive a 
fetch address offset and is further coupled to convey signals 1704 to predict circuit 900 
and target select circuit 1 100. Target select circuit 1 100 and predict circuit 900 are 
coupled to receive branch prediction entry information from local predictor 206. Control 

15 circuit 1 102 is coupled to predict circuit 900, target select circuit 1 100, local predictor 
206, and global predictor 205. Generally, comparison circuit 802 receives a fetch address 
as described above, and conveys signals 1704 to circuits 900 and 1100. Predict circuit 
900 is configured to determine whether a branch prediction is made based on branch 
marker bits received from local predictor 206 and signals from circuit 802, and conveys 

20 the resulting prediction 1710 to control circuit 1 102. Target select circuit 1 100 also 

utilizes branch marker bits received from local predictor 206 and conveys an indication 
1706 to control circuit 1 102 as to which branch target is to be used in the event of a taken 
prediction. Control circuit also receives branch target information 1714 and conveys a 
signal 240 to multiplexor 202 selecting a fetch address. In addition, in one embodiment, 

25 circuit 1 102 also conveys a branch prediction 250 to branch address calculator 270. Also, 
while the described embodiment includes a global predictor mechanism which may 
provide an alternate prediction for a particular branch, the mechanism may be utilized 
without a global predictor mechanism. 
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The target select circuit 1100 shown in Fig. 16 may generally be configured to 
select one target from among a number of targets for use in the branch prediction. In one 
embodiment, target select circuit 1 100 may determine a number of branch marker bits 
which are set for instruction bytes corresponding to offsets which are prior to the offset of 

5 the received fetch address. Based on this information, a first, second or third branch target 
may be selected (for an embodiment including three branch targets). For example, assume 
three possible branch targets are available and an offset equal to 6 has been received. 
Circuit 1 100 may determine the number of branch marker bits which are set among the 
range of branch marker bits occurring prior to branch marker bit 6 (i.e., branch marker 

10 bits 0-5). If no branch marker bits are set in the range, then the branch is identified as the 
first predicted taken branch and the first target is selected. If only one branch marker bit is 
set in the range, then the branch is identified as the second predicted taken branch 
instruction and target two is selected. If two branch marker bits are set, then target three is 
selected. 

15 

While there are many possible ways of implementing target select circuit 1 100, 
Fig. 17 illustrates one exemplary embodiment 1800 utilizing dynamic logic. In the 
embodiment of Fig. 17, rows 1202-1216 and columns 1220-1234 of transistors are 
organized in such a way that a target may be selected based on received branch marker 

20 bits and an offset address. In circuit 1800, three target selections are possible, Tl 1212, 
T2 1214, and T3 1218. In general, circuitry 1800 utilizes received branch marker bits and 
signals received from comparison circuit 802 to eliminate particular targets from 
consideration as they are detected. For example, if a single branch marker is detected to 
occur prior to the fetch address offset, then target one is eliminated from consideration 

25 and target two is selected. If two set branch marker bits are detected which occur prior to 
the fetch address offset, then target three is selected. While those skilled in the art may 
readily determine the operation of circuit 1800, a brief explanation follows. 
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The first row 1202 depicted in Fig. 17 consists of pairs of transistors 1220-1234 
which act to determine if there are any branch marker bits set which occur prior to the 
received offset. By default, target Tl 1212 evaluates to true, or binary "1". The value of 
Tl 1212 also serves as an inverted input to a logic AND gate providing a value for T2 

5 1214. Consequently, when Tl 1212 equals a binary "1", T2 evaluates to a binary "0". 
Each pair of transistors in row 1202 receives a branch marker bit and a signal from 
comparison circuit 802 corresponding to the fetch address offset. For example, the pair of 
transistors at column 1220 and row 1202 receives a first input corresponding to branch 
marker bit 0, b o, and a second input which indicates whether the received offset address 

10 is greater than 0 (i.e., a > 0, where the received offset address is represented by ''a"). In 
the event both inputs evaluate to binary "1", target Tl 1212 will evaluate to binary "0", 
indicating there is a predicted taken branch prior to the received fetch address and target 
Tl 1212 is eliminated from consideration as the predicted target. The remaining rows 
1204-1216 are configured to determine whether there are two branch marker bits set prior 

15 to the current offset which would eliminate target T2 1214 from consideration. Row 1204 
compares branch marker bit bo with each of branch marker bits brb?. Row 1206 
compares branch marker bit bi with branch marker bits bi-b?, and so on. In the event two 
branch marker bits are detected to occur prior to the current offset, target T3 1218 
evaluates to "1", and target T2 1214 evaluates to "0". However, if two prior branch 

20 marker bits are not detected to be set by rows 1204-1216, then target T2 1214 evaluates to 
binary "1". As already mentioned, circuitry 1800 is intended to be exemplary only. 
Numerous methods for selecting a corresponding target are possible and are 
contemplated. 

25 Turning now to Fig. 18, one embodiment of control circuit 1 102 is illustrated. 

Included in Fig. 18 are encoder circuitry 1820, and multiplexors 1832 and 1830. 
Multiplexor 1832 is coupled to receive a local prediction 1710 from predictor circuit 900 
and a global prediction 1712 from global predictor 205. Multiplexor 1830 is coupled to 
receive branch information 1714 corresponding to three branch instructions from local 
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predictor 206. In addition, multiplexor 1830 is coupled to receive target select signal 
1706 from target select circuit 1 100. Select signal 1706 selects branch information 1840 
for conveyance from multiplexor 1830 to encoder circuitry 1820. In addition, in the 
embodiment shown a dynamic bit 1808 contained within branch information 1840 is used 

5 to select either a local 1710 or global 1712 prediction 1806 for conveyance from 

multiplexor 1832 to encoder circuitry 1820. Utilizing the branch information 1840 and 
prediction 1806, encoding circuitry 1820 may determine if a branch is predicted taken or 
not. In the event no branch is predicted taken, encoder circuitry 1820 may be configured 
to encode select signal 240 to convey a sequential address 232 from multiplexor 212. 

10 Alternatively, encoder circuitry 1820 may encode signal 240 to select a return address 230 
or a branch target address received from target array 208. In the embodiment shown, 
dynamic bit 1808 may be used to select either a local prediction 1710 or a global 
prediction 1712. In one embodiment, when a branch exhibits behavior which is relatively 
unpredictable, a global branch prediction history may be utilized to improve the accuracy 

15 of predictions for that branch. In such a case, the dynamic bit may be set to indicate a 
global branch prediction is to be utilized rather than a local branch prediction. 

Branch Address Calculation 

20 As previously mentioned, in one embodiment a fetch address 243 selected by 

signal 240 to be conveyed by multiplexor 212 may provide the final branch prediction 
conveyed for a given fetch address by branch prediction unit 16. However, in an 
alternative embodiment, branch prediction unit 14 is configured to perform a branch 
address calculation in order to detect a misprediction at an early stage. Fig. 19 is a block 

25 diagram of branch address calculator 270. In the embodiment shown, branch address 
calculator 270 is configured to receive an address 236 from multiplexor 222, prediction 
information 242 from local predictor 206, a group of instruction bytes 241 from 
instruction cache 16, and a target address 243 from multiplexor 212. Branch address 
calculator 270 is also configured to convey a fetch address 245. 
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In general, branch address calculator 270 is configured to calculate a relative 
branch target address based on a received fetch address 236 and branch instruction 
immediate data 241. The newly calculated target address is then compared to the 
5 predicted target address 243. If the newly calculated target address does not equal the 
predicted target address 243, a mis-prediction is detected and the newly calculated target 
is conveyed as a next fetch address 245. Advantageously, branch mispredictions may be 
detected earlier and a new fetch address calculated earlier. 

10 In the embodiment shown in Fig. 19, information corresponding to a predicted 

branch instruction is conveyed from local predictor 206 via bus 1850. In one 
embodiment, branch information 1850 includes an offset address of the corresponding 
branch instruction within a group of instruction bytes. In addition, a group of instruction 
bytes 241 is conveyed to multiplexor 1406 from instruction cache 16. Utilizing the 

15 received offset and end bit 504 information included in branch information 1850, a select 
signal 1420 may be conveyed to multiplexor 1406 and the corresponding branch 
instruction may be conveyed from multiplexor 1406 to multiplexor 1408. Further, 
utilizing the received branch information 506 included in the received information 1850, 
a signal 1422 may be conveyed to multiplexor 1408 which selects and conveys immediate 

20 data 1424 corresponding to the predicted branch instruction. Fetch address 236 is 
conveyed to multiplexor 1414 and circuit 1402 which is configured to subtract a base 
address from the fetch address 236. In one embodiment, the base address base 
corresponds to the address specified by the corresponding segment portion of the x86 
address translation mechanism. Subsequent to subtracting the base, circuit 1402 conveys 

25 the resulting address to circuit 1404 which is configured to add the resulting address to 
the immediate data 1424 received from multiplexor 1408 and convey the result 1413 to 
circuit 1410. 
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In addition to the above, the predicted target 243 is conveyed to multiplexor 1414 
and circuit 1412 which is configured to adjust the predicted fetch address by subtracting a 
base address and convey the resulting address 1415 to circuit 1410, Upon receiving the 
calculated address 1413 and adjusted fetch address 1415, circuit 1410 is configured to 

5 compare the two. In the event the two address do not compare equally, circuit 1410 is 
configured to select fetch address 236 for conveyance from multiplexor 1414. Circuit 
1430 may be configured to convey the fetch address 236 in the event of a miscompare. In 
the event the calculated and adjusted fetch addresses compare equally, circuit 1430 may 
be configured to not convey a new fetch address. Further, circuit 1430 may be configured 

10 to not convey a new fetch address in response to detecting prediction signal 250 indicates 
a prediction of not taken. 

In one embodiment, two fetch addresses may be determined and conveyed by 
branch prediction unit 14 in response to receiving a fetch address 236. A first fetch 

15 address conveyed from multiplexor 212 may be utilized immediately as a new fetch 
address for use in fetching instructions from instruction cache 16, Simultaneously, the 
fetch address conveyed from multiplexor 212 is conveyed to branch address calculator 
270 to perform the above described comparison. In the event the fetch address conveyed 
via multiplexor 212 does not equal the fetch address calculated by branch address 

20 calculator 270 as described above, branch address calculator 270 conveys a second fetch 
address to be used in fetching instructions from the instruction cache 16. 

Branch Prediction Victim Cache 

25 As mentioned above, victim cache 260 may be utilized to store branch prediction 

information which has been evicted from local predictor storage 206. Fig. 20 is a block 
diagram illustrating one embodiment of the interaction between local predictor storage 
206 and victim cache 260. In addition to local predictor storage 206 and victim cache 
260, Fig. 20 shows Icache 16, L2 Cache 1828, and decoder 400. In the embodiment 
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shown, victim cache 260 is configured to store branch prediction information evicted 
from local predictor storage 206 and L2 Cache 1828 is configured to store data including 
program instructions. 



5 When an entry is evicted from local predictor storage 206, branch marker bits and 

dynamic bits corresponding to the evicted entry are conveyed to victim cache 260 via bus 
2108 for storage within victim cache 260. Other branch prediction information 
corresponding to the evicted entry, such as end adjustment bits 504 and branch info 506 
are discarded. Similarly, in the embodiment shown, data which is evicted from Icache 16 

10 may be conveyed via bus 2106 for storage within L2 Cache 1828. Subsequently, upon 
presentation of a fetch address 236 to local predictor storage 206 and Icache 16, a 
determination is made as to whether a branch prediction entry corresponding to the 
presented fetch address is present within local predictor storage 206. In the event no 
corresponding entry is present within local predictor storage 260, victim cache 260 may 

15 be queried for a corresponding entry. Upon detecting a valid corresponding entry within 
victim cache 260, branch marker bits and dynamic bits are conveyed via bus 2102 to 
decoder 400 and local predictor storage 206. Local predictor storage is configured to store 
the received branch marker bits and dynamic bits in the corresponding entry. In addition, 
a group of instructions corresponding to the fetch address 236 are conveyed via bus 2104 

20 to decoder 400 and Icache 16. 

Utilizing the received instructions and branch marker bits, decoder 400 may then 
rebuild the remaining portion of the branch prediction entry for local predictor storage 
206. Decoder may utilize the branch marker bits received via bus 2102 to determine the 
25 location of predicted taken branches within the group of instructions received via bus 
2104. Further, decoder 400 may decode the identified predicted taken branches to 
determine their type (e.g., unconditional, conditional, etc.), whether the branch ends on an 
even or odd byte, and the size of any immediate data corresponding to the branch 
instruction. Based on this determination, decoder 400 may recreate the remaining portion 
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of the corresponding branch prediction entry for local predictor storage 206. In the 
embodiment shown, the remaining portion of the branch prediction entry corresponds to 
branch information 506 and end adjustment bit 504. Advantageously, a full branch 
prediction entry in local predictor storage 206 is recreated without the need to re-execute 
5 the corresponding group of instructions. Further, only a portion of the branch prediction 
entry need be stored in victim cache 260. Consequently, victim cache 260 may be made 
smaller. 

Fig. 21 further illustrates the recreation of a branch prediction entry in local 
10 predictor storage 206. Fig. 21 includes victim cache 260, decoder 400, and an entry 2100 
in local predictor storage 206. As illustrated, branch marker bits 2120 and dynamic bits 
2122 comprise data which are evicted to victim cache via bus 2108 and retrieved from 
victim cache 260 via bus 2102. Branch information 2130 comprises data corresponding to 
branch information 506 and end adjustment bits 504. Branch information 2130 is 
15 discarded upon eviction of entry 2100 from local predictor storage 206. As described 
above, decoder 400 is configured to recreate branch information 2130 and convey the 
recreated data via 21 10. 

As described above, fetch address 236 is presented to both local predictor storage 
20 206 and Icache 16. However, in alternative embodiments, the fetch address 236 may also 
be presented to victim cache 260 and/or L2 Cache 1828 in parallel with its presentation to 
local predictor storage 206 and Icache 16. Further, in an alternative embodiment, L2 
Cache 1828 may be configured to store data evicted from local predictor storage 206 as 
described above. Fig. 22 illustrates an embodiment wherein L2 Cache 1828 is configured 
25 to store program instructions and corresponding branch prediction information. In the 
embodiment shown, local predictor storage 206 is configured to convey evicted branch 
prediction information to L2 Cache 1828 via bus 2206. Icache 16 may be configured to 
convey evicted program instructions to L2 Cache 1828 via bus 220. Prefetch unit 12 is 
configured to fetch both program instructions and branch prediction information from L2 
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Cache 1828. Prefetch is further configured to recreate a full branch prediction entry based 
on branch information and program instructions fetched from L2 Cache 1828. The full 
branch prediction entry is then conveyed to local predictor storage 206 via bus 2202 and 
the corresponding fetched program instructions may be conveyed to Icache 16 via bus 
5 2204. 

Detecting Missed Predictions 

As previously mentioned, a special case exists involving a single byte RET 
10 instruction. As illustrated in Fig. 14, a single byte RET instruction occurring in particular 
positions which is predicted taken may be overlooked by prediction logic 220 and 
subsequently predicted not taken. The following discussion describes one embodiment of 
branch prediction unit 14 which is configured to detect such missed predictions. Fig. 23 is 
a block diagram showing one embodiment of branch prediction unit 14. The embodiment 
15 of Fig. 23 is similar to that of Fig. 2. However, in the embodiment of Fig. 23, return 
address stack 230 is coupled to multiplexor 221 A, branch address calculator 270A is 
modified as compared to branch address calculator 270, and signal 223 A is configured to 
select from one of the three inputs to multiplexor 221 A. In general, the embodiment 
shown in Fig. 23 operates as before. However, branch address calculator 270A is 
20 configured to detect missed predictions corresponding to single byte RET instructions and 
select a fetch address from the return stack 230 in response. 

Fig 24 shows one embodiment of branch address calculator 270A. Branch address 
calculator 270A is configured similar to that of branch address calculator 270 and may 
25 calculate a second fetch address for conveyance via bus 245 as described above. 

However, rather than conveying an address 245 and control signal 223 from circuit 1430 
as in branch address calculator 270, circuit 1430 is configured to convey a potential 
second fetch address 2410 to control circuit 2400 and a corresponding select signal 2412 
to multiplexor 2402. In addition, branch address calculator 270A includes missed 
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prediction circuit 2450 which is configured to detect missed predictions corresponding to 
single byte RET instructions. Missed prediction circuit 2450 is coupled to receive branch 
target information 450 from local predictor storage 206, prediction 250 from prediction 
logic 220, and fetch address 236. Further, circuit 2450 is coupled to convey select signals 
5 2420 and 2422 to multiplexor 2402. Signal 2422 is further coupled to control circuit 
2400. 

In response to detecting a missed prediction, missed prediction circuit 2450 
conveys select signal 2420 which is configured to select a return address from 

10 multiplexor 221 A, and select signal 2422 which indicates detection of a missed prediction 
and is configured to select the signal 2420 for output from multiplexor 2402. In one 
embodiment, missed prediction circuit 2450 may be configured to always select signal 
2412 for conveyance from multiplexor 2402 in the event prediction 250 indicates a 
prediction of taken. In this manner, missed prediction circuit 2450 may only perform 

15 detection of a missed prediction when prediction logic 220 conveys a prediction of not 
taken. Multiplexor 2402 is configured to convey a signal 2460 which may be configured 
to select a second fetch address 245 from multiplexor 221 A, or may be configured to 
select a return address from multiplexor 221 A. 

20 Control circuit 2400 is configured to determine whether a second fetch address is 

necessitated by a misprediction, or a missed prediction of a RET instruction, and convey 
corresponding information via bus 245 and signal 223 A. In one embodiment, signal 2410 
includes a fetch address and an indication of a miscompare by circuit 1410. In the 
embodiment shown, control circuit 2400 may determine a second fetch address is 

25 required in response to detecting one of two conditions. A first condition requiring a 

second fetch address corresponds to detecting a prediction 250 of taken and detection of a 
miscompare by circuit 1410 as indicated by signal 2410. In response to detecting this first 
condition, control circuit is configured to convey the received address 2410 via bus 245 
and a corresponding select signal 223A. In this case, select signal 223A corresponds to 
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the signal 2412 conveyed from circuit 1430 and is configured to select signal 245 for 
conveyance from multiplexor 221A. A second condition requiring a second fetch address 
corresponds to detecting a prediction 250 of not taken and detection of a missed 
prediction as indicated by signal 2422. In response to detecting this second condition, 
5 control circuit 2400 conveys a select signal 223A which corresponds to signal 2420 
conveyed by missed prediction circuit 2450. In this second case, the conveyed select 
signal 223 A is configured to select a return address 230 for conveyance from multiplexor 
221 A. If neither the first nor second condition are detected by control circuit 2400, no 
second fetch address is conveyed. 

10 

Fig. 25 is a block diagram illustrating one embodiment of missed prediction 
circuit 2450. Missed prediction circuit 2450 includes candidate circuit 2502, even byte 
circuit 2504, matching circuit 2506, and control circuit 2508. Candidate circuit 2502 is 
coupled to receive branch information 450, even byte circuit 2504 is coupled to receive 
15 fetch address 236, and control circuit 2508 is coupled to receive prediction 250. Further, 
match circuit 2506 is coupled to receive signals 2520 and 2522 from candidate circuit 
2502 and even byte circuit 2504, respectively. Control circuit 2508 is coupled to receive 
signal 2530 from match circuit 2506. 

20 In the embodiment shown in Fig. 25, candidate circuit 2502 is configured to 

determine whether branch information 450 includes a valid entry corresponding to a RET 
instruction at an even byte position. As described above, branch information 450 may 
include branch information corresponding to three branch instructions 500A-500C. 
Utilizing the encodings shown in Fig. 15, a RET instruction may be identified as one in 

25 which branch information bit #3 is equal to binary "1". Further, end adjustment bit may 
be utilized to detect an instruction ending on an even byte. Branch information 500A- 
500C which is determined to correspond to a RET instruction on an even byte may then 
be considered a missed prediction candidate and may be conveyed to match circuit 2506 
along with a positive indication of candidate detection. Even byte circuit 2504 is 



43 



configured to determine a fetch address corresponding to an even address. In one 
embodiment, even byte circuit 2504 may compare a least significant bit of a received 
fetch address 236 in order to make this determination. If the least significant bit of the 
fetch address 236 is detected to equal a binary "0", an even fetch address may be 
5 determined and a corresponding positive indication 2522 may be conveyed to match 
circuit 2506. 

In response to receiving a positive indication from circuit 2502 and 2504, match 
circuit 2506 is configured to detect a missed prediction candidate v^hich corresponds the 
10 fetch address 236. In one embodiment, bits 3-1 of the offset of the fetch address 236 are 
compared to bits 2-0 of a candidate's branch information. As previously described, bits 2- 
0 of a RET instruction's branch information 506 indicate the even byte position of the 
RET instruction. The following table illustrates a relationship between even fetch address 
offsets and byte position branch information. 

15 



Even Fetch Address 
Offset 
(bits 3-0) 


Branch Information 
Bvte position 
(bits 2-0) 


0000 


000 


0010 


001 


0100 


010 


0110 


on 


1000 


100 


1010 


101 


1100 


no 


1110 


111 



Table 1 
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As seen from Table 1, a direct correspondence may be made between bits 3-1 of an even 
fetch address offset and bits 2-0 of branch information 506. Consequently, match circuit 
2506 is able to match candidate branch information corresponding to a RET instruction to 
the fetch address offset. In response to detecting such a match, match circuit 2506 is 
5 configured to convey a signal 2530 indicating such detection to control circuit 2508. In 
the exemplary embodiment shown, control circuit 2508 is configured to convey a signals 
configured to select a return address from multiplexor 221 A, in response to detecting a 
not taken prediction 250 and an indication of a match 2530, In order to effect the 
selection of a return address 230 from multiplexor 221 A, control circuit 2508 conveys 

10 signal 2422 and signal 2420. Signal 2420 is configured with an encoding to select a return 
address 230 from multiplexor 221 A. Select signal 2422 is configured to select for output 
from multiplexor 2422 either signal 2412 or signal 2420. In response to detecting a not 
taken prediction 250 and an indication of a match 2530, signal 2422 selects signal 2420 
for output from multiplexor 2402. Otherwise, signal 2422 selects signal 2412 for output 

1 5 from multiplexor 2402. 

Turning now to Fig. 26, a block diagram of one embodiment of a computer 
system 2600 including processor 10 coupled to a variety of system components through a 
bus bridge 2602 is shown. Other embodiments are possible and contemplated. In the 

20 depicted system, a main memory 2604 is coupled to bus bridge 2602 through a memory 
bus 2606, and a graphics controller 2608 is coupled to bus bridge 2602 through an AGP 
bus 2610. Finally, a plurality of PCI devices 2612A-2612B are coupled to bus bridge 
2602 through a PCI bus 2614. A secondary bus bridge 2616 may further be provided to 
accommodate an electrical interface to one or more EISA or ISA devices 2618 through an 

25 EISA/ISA bus 2620. Processor 10 is coupled to bus bridge 2602 through a CPU bus 
2624 and to an optional L2 cache 1828. 

Bus bridge 2602 provides an interface between processor 10, main memory 2604, 
graphics controller 2608, and devices attached to PCI bus 2614. When an operation is 



45 



received from one of the devices connected to bus bridge 2602, bus bridge 2602 identifies 
the target of the operation (e.g. a particular device or, in the case of PCI bus 2614, that the 
target is on PCI bus 2614). Bus bridge 2602 routes the operation to the targeted device. 
Bus bridge 2602 generally translates an operation from the protocol used by the source 
5 device or bus to the protocol used by the target device or bus. 

In addition to providing an interface to an ISA/EISA bus for PCI bus 2614, 
secondary bus bridge 2616 may further incorporate additional functionality, as desired. 
An input/output controller (not shown), either external from or integrated with secondary 

10 bus bridge 2616, may also be included within computer system 2600 to provide 

operational support for a keyboard and mouse 2622 and for various serial and parallel 
ports, as desired. An external cache unit (not shown) may further be coupled to CPU bus 
2624 between processor 10 and bus bridge 2602 in other embodiments. Alternatively, the 
external cache may be coupled to bus bridge 2602 and cache control logic for the external 

15 cache may be integrated into bus bridge 2602. L2 cache 1828 is further shown in a 
backside configuration to processor 10. It is noted that L2 cache 1828 may be separate 
from processor 10, integrated into a cartridge (e.g. slot 1 or slot A) with processor 10, or 
even integrated onto a semiconductor substrate with processor 10. 

20 Main memory 2604 is a memory in which application programs are stored and 

from which processor 10 primarily executes. A suitable main memory 2604 comprises 
DRAM (Dynamic Random Access Memory). For example, a plurality of banks of 
SDRAM (Synchronous DRAM) or Rambus DRAM (RDRAM) may be suitable. 

25 PCI devices 2612A-2612B are illustrative of a variety of peripheral devices such 

as, for example, network interface cards, video accelerators, audio cards, hard or floppy 
disk drives or drive controllers, SCSI (Small Computer Systems Interface) adapters and 
telephony cards. Similarly, ISA device 2618 is illustrative of various types of peripheral 
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devices, such as a modem, a sound card, and a variety of data acquisition cards such as 
GPIB or field bus interface cards, 

Graphics controller 2608 is provided to control the rendering of text and images 
5 on a display 2626. Graphics controller 2608 may embody a typical graphics accelerator 
generally known in the art to render three-dimensional data structures which can be 
effectively shifted into and from main memory 2604. Graphics controller 2608 may 
therefore be a master of AGP bus 2610 in that it can request and receive access to a target 
interface within bus bridge 2602 to thereby obtain access to main memory 2604. A 
10 dedicated graphics bus accommodates rapid retrieval of data from main memory 2604. 
For certain operations, graphics controller 2608 may further be configured to generate 
PCI protocol transactions on AGP bus 2610. The AGP interface of bus bridge 2602 may 
thus include functionality to support both AGP protocol transactions as well as PCI 
protocol target and initiator transactions. Display 2626 is any electronic display upon 
15 which an image or text can be presented. A suitable display 2626 includes a cathode ray 
tube ("CRT"), a liquid crystal display ("LCD"), etc. 

It is noted that, while the AGP, PCI, and ISA or EISA buses have been used as 
examples in the above description, any bus architectures may be substituted as desired. It 

20 is further noted that computer system 2600 may be a multiprocessing computer system 
including additional processors (e.g. processor 10a shown as an optional component of 
computer system 2600). Processor 10a may be similar to processor 10. More 
particularly, processor 10a may be an identical copy of processor 10. Processor 10a may 
be connected to bus bridge 2602 via an independent bus (as shown in Fig. 4) or may share 

25 CPU bus 2624 with processor 10. Furthermore, processor 10a may be coupled to an 
optional L2 cache 1828a similar to L2 cache 1828. 

It is noted that the present discussion may refer to the assertion of various signals. 
As used herein, a signal is "asserted" if it conveys a value indicative of a particular 
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condition. Conversely, a signal is "deasserted" if it conveys a value indicative of a lack of 
a particular condition. A signal may be defined to be asserted when it conveys a logical 
zero value or, conversely, when it conveys a logical one value. Additionally, various 
values have been described as being discarded in the above discussion. A value may be 

5 discarded in a number of manners, but generally involves modifying the value such that it 
is ignored by logic circuitry which receives the value. For example, if the value 
comprises a bit, the logic state of the value may be inverted to discard the value. If the 
value is an n-bit value, one of the n-bit encodings may indicate that the value is invalid. 
Setting the value to the invalid encoding causes the value to be discarded. Additionally, 

10 an n-bit value may include a vaUd bit indicative, when set, that the n-bit value is valid. 
Resetting the valid bit may comprise discarding the value. Other methods of discarding a 
value may be used as well. 

Numerous variations and modifications will become apparent to those skilled in 
15 the art once the above disclosure is fully appreciated. It is intended that the following 
claims be interpreted to embrace all such variations and modifications. 
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